Advantages of multi-arm non-randomised sequentially allocated cohort designs for Phase II oncology trials.

BACKGROUND: Efficient trial designs are required to prioritise promising drugs within Phase II trials. Adaptive designs are examples of such designs, but their efficiency is reduced if there is a delay in assessing patient responses to treatment. METHODS: Motivated by the WIRE trial in renal cell carcinoma (NCT03741426), we compare three trial approaches to testing multiple treatment arms: (1) single-arm trials in sequence with interim analyses; (2) a parallel multi-arm multi-stage trial and (3) the design used in WIRE, which we call the Multi-Arm Sequential Trial with Efficient Recruitment (MASTER) design. The MASTER design recruits patients to one arm at a time, pausing recruitment to an arm when it has recruited the required number for an interim analysis. We conduct a simulation study to compare how long the three different trial designs take to evaluate a number of new treatment arms. RESULTS: The parallel multi-arm multi-stage and the MASTER design are much more efficient than separate trials. The MASTER design provides extra efficiency when there is endpoint delay, or recruitment is very quick. CONCLUSIONS: We recommend the MASTER design as an efficient way of testing multiple promising cancer treatments in non-comparative Phase II trials.

Contribución del farmacéutico cubano a la calidad de un ensayo clínico / Contribution of the Cuban pharmaceutical to the quality of a clinical trial

Una de las etapas culminantes del desarrollo de un producto en investigación es el ensayo clínico. Esta investigación se lleva a cabo en sujetos humanos y se dirige a verificar o descubrir los efectos clínicos, farmacológicos y/o farmacodinámicos del producto o equipo que se estudia.Para garantizar la calidad de estas investigaciones se utiliza como estándar las Buenas Prácticas Clínicas, donde se establecen requisitos a cumplir por los participantes, para asegurar calidad de los datos y protección de los derechos, integridad y confidencialidad de los sujetos.Un copartícipe importante es el farmacéutico, por el rol que desempeña. Este trabajo se centró en mostrar los elementos a tener en cuenta por el farmacéutico cubano para contribuir a elevar la calidad de un ensayo clínico.Dentro de los elementos a cumplir se encontraron; la cualificación, el cumplimiento y dominio del protocolo en lo referido al manejo del producto, el completamiento adecuado y en tiempo de la documentación que se genera según las funciones en el ensayo, velar por las condiciones de almacenamiento, vencimiento y devolución del producto, además de estar preparado para recibir actividades de monitoreo, auditoría y/o inspecciones, trabajar con enfoque de riesgo y por la mejora continua.El farmacéutico que participa en un ensayo clínico deberá dominar y aplicar los elementos identificados para tributar a la protección de los sujetos y confiablidad de los datos, elevando la calidad de los ensayos clínicos. (AU)

One of the culminating stages of the development of a product under investigation is the clinical trial. This research is carried out in human subjects and is aimed at verifying or discovering the clinical, pharmacological and/or pharmacodynamic effects of the product or equipment being studied.To guarantee the quality of these investigations, the Good Clinical Practices are used as standard, where requirements are established to be met by the participants, to ensure data quality and protection of the rights, integrity and confidentiality of the subjects.An important partner is the pharmacist. This work focused on showing the elements to be taken into account by the Cuban pharmacist to help raise the quality of a clinical trial.Among the elements to meet were found; the qualification, compliance and mastery of the protocol in relation to the handling of the product, the adequate and timely completion of the documentation that is generated according to the functions in the test, ensure the storage conditions, expiration and return of the product, in addition to be prepared to receive monitoring, audit and/or inspection activities, work with a risk approach and for continuous improvement.The pharmacist participating in a clinical trial must master and apply the elements identified to contribute to the protection of the subjects and the reliability of the data, raising the quality of the clinical trials. (AU)

How can health economics be used in the design and analysis of adaptive clinical trials? A qualitative analysis.

INTRODUCTION: Adaptive designs offer a flexible approach, allowing changes to a trial based on examinations of the data as it progresses. Adaptive clinical trials are becoming a popular choice, as the prudent use of finite research budgets and accurate decision-making are priorities for healthcare providers around the world. The methods of health economics, which aim to maximise the health gained for money spent, could be incorporated into the design and analysis of adaptive clinical trials to make them more efficient. We aimed to understand the perspectives of stakeholders in health technology assessments to inform recommendations for the use of health economics in adaptive clinical trials. METHODS: A qualitative study explored the attitudes of key stakeholders-including researchers, decision-makers and members of the public-towards the use of health economics in the design and analysis of adaptive clinical trials. Data were collected using interviews and focus groups (29 participants). A framework analysis was used to identify themes in the transcripts. RESULTS: It was considered that answering the clinical research question should be the priority in a clinical trial, notwithstanding the importance of cost-effectiveness for decision-making. Concerns raised by participants included handling the volatile nature of cost data at interim analyses; implementing this approach in global trials; resourcing adaptive trials which are designed and adapted based on health economic outcomes; and training stakeholders in these methods so that they can be implemented and appropriately interpreted. CONCLUSION: The use of health economics in the design and analysis of adaptive clinical trials has the potential to increase the efficiency of health technology assessments worldwide. Recommendations are made concerning the development of methods allowing the use of health economics in adaptive clinical trials, and suggestions are given to facilitate their implementation in practice.

A review of available software for adaptive clinical trial design.

BACKGROUND/AIMS: The increasing cost of the drug development process has seen interest in the use of adaptive trial designs grow substantially. Accordingly, much research has been conducted to identify barriers to increasing the use of adaptive designs in practice. Several articles have argued that the availability of user-friendly software will be an important step in making adaptive designs easier to implement. Therefore, we present a review of the current state of software availability for adaptive trial design. METHODS: We review articles from 31 journals published in 2013-2017 that relate to methodology for adaptive trials to assess how often code and software for implementing novel adaptive designs is made available at the time of publication. We contrast our findings against these journals' policies on code distribution. We also search popular code repositories, such as Comprehensive R Archive Network and GitHub, to identify further existing user-contributed software for adaptive designs. From this, we are able to direct interested parties toward solutions for their problem of interest. RESULTS: Only 30% of included articles made their code available in some form. In many instances, articles published in journals that had mandatory requirements on code provision still did not make code available. There are several areas in which available software is currently limited or saturated. In particular, many packages are available to address group sequential design, but comparatively little code is present in the public domain to determine biomarker-guided adaptive designs. CONCLUSIONS: There is much room for improvement in the provision of software alongside adaptive design publications. In addition, while progress has been made, well-established software for various types of trial adaptation remains sparsely available.

Quantification of prior impact in terms of effective current sample size.

Bayesian methods allow borrowing of historical information through prior distributions. The concept of prior effective sample size (prior ESS) facilitates quantification and communication of such prior information by equating it to a sample size. Prior information can arise from historical observations; thus, the traditional approach identifies the ESS with such a historical sample size. However, this measure is independent of newly observed data, and thus would not capture an actual "loss of information" induced by the prior in case of prior-data conflict. We build on a recent work to relate prior impact to the number of (virtual) samples from the current data model and introduce the effective current sample size (ECSS) of a prior, tailored to the application in Bayesian clinical trial designs. Special emphasis is put on robust mixture, power, and commensurate priors. We apply the approach to an adaptive design in which the number of recruited patients is adjusted depending on the effective sample size at an interim analysis. We argue that the ECSS is the appropriate measure in this case, as the aim is to save current (as opposed to historical) patients from recruitment. Furthermore, the ECSS can help overcome lack of consensus in the ESS assessment of mixture priors and can, more broadly, provide further insights into the impact of priors. An R package accompanies the paper.

An adaptive trial design to optimize dose-schedule regimes with delayed outcomes.

This paper proposes a two-stage phase I-II clinical trial design to optimize dose-schedule regimes of an experimental agent within ordered disease subgroups in terms of the toxicity-efficacy trade-off. The design is motivated by settings where prior biological information indicates it is certain that efficacy will improve with ordinal subgroup level. We formulate a flexible Bayesian hierarchical model to account for associations among subgroups and regimes, and to characterize ordered subgroup effects. Sequentially adaptive decision-making is complicated by the problem, arising from the motivating application, that efficacy is scored on day 90 and toxicity is evaluated within 30 days from the start of therapy, while the patient accrual rate is fast relative to these outcome evaluation intervals. To deal with this in a practical manner, we take a likelihood-based approach that treats unobserved toxicity and efficacy outcomes as missing values, and use elicited utilities that quantify the efficacy-toxicity trade-off as a decision criterion. Adaptive randomization is used to assign patients to regimes while accounting for subgroups, with randomization probabilities depending on the posterior predictive distributions of utilities. A simulation study is presented to evaluate the design's performance under a variety of scenarios, and to assess its sensitivity to the amount of missing data, the prior, and model misspecification.

Two-stage enrichment clinical trial design with adjustment for misclassification in predictive biomarkers.

A two-stage enrichment design is a type of adaptive design, which extends a stratified design with a futility analysis on the marker negative cohort at the first stage, and the second stage can be either a targeted design with only the marker positive stratum, or still the stratified design with both marker strata, depending on the result of the interim futility analysis. In this paper, we consider the situation where the marker assay and the classification rule are possibly subject to error. We derive the sequential tests for the global hypothesis as well as the component tests for the overall cohort and the marker-positive cohort. We discuss the power analysis with the control of the type I error rate and show the adverse impact of the misclassification on the powers. We also show the enhanced power of the two-stage enrichment over the one-stage design and illustrate with examples of the recent successful development of immunotherapy in non-small-cell lung cancer.

Multi-stage enrichment and basket trial designs with population selection.

As biomarker information from early-phase trials can be unreliable due to high variability, it is logical to take a prospective two-stage approach when designing a late-phase confirmatory trial, ie, refining the target population at the first stage and performing the hypothesis testing at the second stage. The use of a reliable intermediate endpoint at the first stage can further improve the trial efficiency from both time and cost perspectives. Nevertheless, there are needs for expanding such two-stage confirmatory designs to more stages for monitoring efficacy on the refined population. There is limited literature on this matter, particularly for two popular designs with population selection midway, ie, the biomarker enrichment design and the basket design. In this manuscript, we focus on these two popular designs and discuss how to implement the interim efficacy analyses after population refinement while controlling type I error. Power and stopping probability are also explored for the two designs.

To add or not to add a new treatment arm to a multiarm study: A decision-theoretic framework.

Multiarm clinical trials, which compare several experimental treatments against control, are frequently recommended due to their efficiency gain. In practise, all potential treatments may not be ready to be tested in a phase II/III trial at the same time. It has become appealing to allow new treatment arms to be added into on-going clinical trials using a "platform" trial approach. To the best of our knowledge, many aspects of when to add arms to an existing trial have not been explored in the literature. Most works on adding arm(s) assume that a new arm is opened whenever a new treatment becomes available. This strategy may prolong the overall duration of a study or cause reduction in marginal power for each hypothesis if the adaptation is not well accommodated. Within a two-stage trial setting, we propose a decision-theoretic framework to investigate when to add or not to add a new treatment arm based on the observed stage one treatment responses. To account for different prospect of multiarm studies, we define utility in two different ways; one for a trial that aims to maximise the number of rejected hypotheses; the other for a trial that would declare a success when at least one hypothesis is rejected from the study. Our framework shows that it is not always optimal to add a new treatment arm to an existing trial. We illustrate a case study by considering a completed trial on knee osteoarthritis.

A Review of Clinical Trials With an Adaptive Design and Health Economic Analysis.

OBJECTIVE: An adaptive design uses data collected as a clinical trial progresses to inform modifications to the trial. Hence, adaptive designs and health economics aim to facilitate efficient and accurate decision making. Nevertheless, it is unclear whether the methods are considered together in the design, analysis, and reporting of trials. This review aims to establish how health economic outcomes are used in the design, analysis, and reporting of adaptive designs. METHODS: Registered and published trials up to August 2016 with an adaptive design and health economic analysis were identified. The use of health economics in the design, analysis, and reporting was assessed. Summary statistics are presented and recommendations formed based on the research team's experiences and a practical interpretation of the results. RESULTS: Thirty-seven trials with an adaptive design and health economic analysis were identified. It was not clear whether the health economic analysis accounted for the adaptive design in 17/37 trials where this was thought necessary, nor whether health economic outcomes were used at the interim analysis for 18/19 of trials with results. The reporting of health economic results was suboptimal for the (17/19) trials with published results. CONCLUSIONS: Appropriate consideration is rarely given to the health economic analysis of adaptive designs. Opportunities to use health economic outcomes in the design and analysis of adaptive trials are being missed. Further work is needed to establish whether adaptive designs and health economic analyses can be used together to increase the efficiency of health technology assessments without compromising accuracy.

Outcome-adaptive randomization in clinical trials: issues of participant welfare and autonomy.

Outcome-adaptive randomization (OAR) has been proposed as a corrective to certain ethical difficulties inherent in the traditional randomized clinical trial (RCT) using fixed-ratio randomization. In particular, it has been suggested that OAR redresses the balance between individual and collective ethics in favour of the former. In this paper, I examine issues of welfare and autonomy arising in relation to OAR. A central issue in discussions of welfare in OAR is equipoise, and the moral status of OAR is crucially influenced by the way in which this concept is construed. If OAR is based on a model of equipoise that demands strict indifference between competing interventions throughout the trial, such equipoise is disturbed by accruing data favouring one treatment over another; OAR seeks to redress this by weighting randomization to the seemingly superior treatment. However, this is a partial response, as patients continue to be allocated to the inferior therapy. Moreover, it rests upon considerations of aggregate harms and benefits, and does not therefore uphold individual ethics. Issues of fairness also arise, as early and late enrollees are randomized on a different basis. Fixed-ratio randomization represents a fuller and more consistent response to a loss of equipoise, as so construed. With regard to consent, the complexity of OAR poses challenges to adequate disclosure and comprehension. Additionally, OAR does not offer a remedy to the therapeutic misconception-participants' tendency to attribute treatment allocation in an RCT to individual clinical judgments, rather than to scientific considerations-and, if anything, accentuates rather than alleviates this misconception. In relation to these issues, OAR fails to offer ethical advantages over fixed-ratio randomization. More broadly, the ethical basis of OAR can be seen to lie more in collective than in individual ethics, and overall it fares worse in this territory than fixed-ratio randomization.

Familywise error control in multi-armed response-adaptive trials.

Response-adaptive designs allow the randomization probabilities to change during the course of a trial based on cumulated response data so that a greater proportion of patients can be allocated to the better performing treatments. A major concern over the use of response-adaptive designs in practice, particularly from a regulatory viewpoint, is controlling the type I error rate. In particular, we show that the naïve z-test can have an inflated type I error rate even after applying a Bonferroni correction. Simulation studies have often been used to demonstrate error control but do not provide a guarantee. In this article, we present adaptive testing procedures for normally distributed outcomes that ensure strong familywise error control by iteratively applying the conditional invariance principle. Our approach can be used for fully sequential and block randomized trials and for a large class of adaptive randomization rules found in the literature. We show there is a high price to pay in terms of power to guarantee familywise error control for randomization schemes with extreme allocation probabilities. However, for proposed Bayesian adaptive randomization schemes in the literature, our adaptive tests maintain or increase the power of the trial compared to the z-test. We illustrate our method using a three-armed trial in primary hypercholesterolemia.

A Data Analysis Method for Using Longitudinal Binary Outcome Data from a SMART to Compare Adaptive Interventions.

Sequential multiple assignment randomized trials (SMARTs) are a useful and increasingly popular approach for gathering information to inform the construction of adaptive interventions to treat psychological and behavioral health conditions. Until recently, analysis methods for data from SMART designs considered only a single measurement of the outcome of interest when comparing the efficacy of adaptive interventions. Lu et al. proposed a method for considering repeated outcome measurements to incorporate information about the longitudinal trajectory of change. While their proposed method can be applied to many kinds of outcome variables, they focused mainly on linear models for normally distributed outcomes. Practical guidelines and extensions are required to implement this methodology with other types of repeated outcome measures common in behavioral research. In this article, we discuss implementation of this method with repeated binary outcomes. We explain how to compare adaptive interventions in terms of various summaries of repeated binary outcome measures, including average outcome (area under the curve) and delayed effects. The method is illustrated using an empirical example from a SMART study to develop an adaptive intervention for engaging alcohol- and cocaine-dependent patients in treatment. Monte Carlo simulations are provided to demonstrate the good performance of the proposed technique.

Maximum likelihood estimation of generalized linear models for adaptive designs: Applications and asymptotics.

Due to increasing discoveries of biomarkers and observed diversity among patients, there is growing interest in personalized medicine for the purpose of increasing the well-being of patients (ethics) and extending human life. In fact, these biomarkers and observed heterogeneity among patients are useful covariates that can be used to achieve the ethical goals of clinical trials and improving the efficiency of statistical inference. Covariate-adjusted response-adaptive (CARA) design was developed to use information in such covariates in randomization to maximize the well-being of participating patients as well as increase the efficiency of statistical inference at the end of a clinical trial. In this paper, we establish conditions for consistency and asymptotic normality of maximum likelihood (ML) estimators of generalized linear models (GLM) for a general class of adaptive designs. We prove that the ML estimators are consistent and asymptotically follow a multivariate Gaussian distribution. The efficiency of the estimators and the performance of response-adaptive (RA), CARA, and completely randomized (CR) designs are examined based on the well-being of patients under a logit model with categorical covariates. Results from our simulation studies and application to data from a clinical trial on stroke prevention in atrial fibrillation (SPAF) show that RA designs lead to ethically desirable outcomes as well as higher statistical efficiency compared to CARA designs if there is no treatment by covariate interaction in an ideal model. CARA designs were however more ethical than RA designs when there was significant interaction.

Adaptive designs in clinical trials: from scientific advice to marketing authorisation to the European Medicine Agency.

BACKGROUND: In recent years, experience on the application of adaptive designs in confirmatory clinical trials has accumulated. Although planning such trials comes at the cost of additional operational complexity, adaptive designs offer the benefit of flexibility to update trial design and objectives as data accrue. In 2007, the European Medicines Agency (EMA) provided guidance on confirmatory clinical trials with adaptive (or flexible) designs. In order to better understand how adaptive trials are implemented in practice and how they may impact medicine approval within the EMA centralised procedure, we followed on 59 medicines for which an adaptive clinical trial had been submitted to the EMA Scientific Advice (SA) and analysed previously in a dedicated EMA survey of scientific advice letters. We scrutinized in particular the submission of the corresponding medicines for a marketing authorisation application (MAA). We also discuss the current regulatory perspective as regards the implementation of adaptive designs in confirmatory clinical trials. METHODS: Using the internal EMA MAA database, the AdisInsight database and related trial registries, we analysed how many of these 59 trials actually started, the completion status, results, the time to trial start, the adaptive elements finally implemented after SA, their possible influence on the success of the trial and corresponding product approval. RESULTS: Overall 31 trials out of 59 (53%) were retrieved. Thirty of them (97%) have been started and 23 (74%) concluded. Nine of these trials (39% out of 23) demonstrated a significant treatment effect on their primary endpoint and 4 (17% out of 23) supported a marketing authorisation (MA). An additional two trials were stopped using pre-defined criteria for futility, efficiently identifying trials on which further resources should not be spent. Median time to trial start after SA letter was given by EMA was 5 months. In the investigated trial registries, at least 18 trial (58% of 31 retrieved trials) designs were implemented with adaptive elements, which were predominantly dose selection, sample size reassessment (SSR) and stopping for futility (SFF). Among the 11 completed trials including adaptive elements, 6 demonstrated a significant treatment effect on their primary endpoint (55%). CONCLUSIONS: Adaptive designs are now well established in the drug development landscape. If properly pre-planned, adaptations can play a key role in the success of some of these trials, for example to help successfully select the most promising dose regimens for phase II/III trials. Interim analyses can also enable stopping of trials for futility when they do not hold their promises. Type I error rate control, trial integrity and results consistency between the different stages of the analyses are fundamental aspects to be discussed thoroughly. Engaging early dialogue with regulators and implementing the scientific advice received is strongly recommended, since much experience in discussing adaptive designs and assessing their results has been accumulated.

Multi-arm multi-stage trials can improve the efficiency of finding effective treatments for stroke: a case study.

BACKGROUND: Many recent Stroke trials fail to show a beneficial effect of the intervention late in the development. Currently a large number of new treatment options are being developed. Multi-arm multi-stage (MAMS) designs offer one potential strategy to avoid lengthy studies of treatments without beneficial effects while at the same time allowing evaluation of several novel treatments. In this paper we provide a review of what MAMS designs are and argue that they are of particular value for Stroke trials. We illustrate this benefit through a case study based on previous published trials of endovascular treatment for acute ischemic stroke. We show in this case study that MAMS trials provide additional power for the same sample size compared to alternative trial designs. This level of additional power depends on the recruitment length of the trial, with most efficiency gained when recruitment is relatively slow. We conclude with a discussion of additional considerations required when starting a MAMS trial. CONCLUSION: MAMS trial designs are potentially very useful for stroke trials due to their improved statistical power compared to the traditional approach.

The design of an adaptive clinical trial to evaluate the efficacy of platelets stored at low temperature in surgical patients.

BACKGROUND: Storage of platelets at 4°C compared with 22°C may increase both hemostatic activity and storage duration; however, the maximum duration of cold storage is unknown. We report the design of an innovative, prospective, randomized, Bayesian adaptive, "duration finding" clinical trial to evaluate the efficacy and maximum duration of storage of platelets at 4°C. METHODS: Patients undergoing cardiac surgery and requiring platelet transfusions will be enrolled. Patients will be randomized to receive platelets stored at 22°C up to 5 days or platelets stored at 4°C up to 5 days, 10 days, or 15 days. Longer durations of cold storage will only be used if shorter durations at 4°C appear noninferior to standard storage, based on a four-level clinical hemostatic efficacy score with a NIM of a half level. A Bayesian linear model is used to estimate the hemostatic efficacy of platelet transfusions based on the actual duration of storage at 4°C. RESULTS: The type I error rate, if platelets stored at 4°C are inferior, is 0.0247 with an 82% probability of early stopping for futility. With a maximum sample size of 1,500, the adaptive trial design has a power of over 90% to detect noninferiority and a high probability of correctly identifying the maximum duration of storage at 4°C that is noninferior to 22°C. CONCLUSION: An adaptive, duration-finding trial design will generate Level I evidence and allow the determination of the maximum duration platelet storage at 4°C that is noninferior to standard storage at 22°C, with respect to hemostatic efficacy. The adaptive trial design helps to ensure that longer cold storage durations are only explored once substantial supportive data are available for the shorter duration(s) and that the trial stops early if continuation is likely to be futile.

A response adaptive design for ordinal categorical responses.

A two treatment response adaptive design is developed for phase III clinical trials with ordinal categorical treatment outcome using Goodman-Kruskal measure of association. Properties of the proposed design are studied both empirically and theoretically and the acceptability is further illustrated using two real data-sets; one from a clinical trial with trauma patients and the other from a trial with patients having rheumatoid arthritis.